comparison outcome
Just Sort It! A Simple and Effective Approach to Active Preference Learning
Maystre, Lucas, Grossglauser, Matthias
We address the problem of learning a ranking by using adaptively chosen pairwise comparisons. Our goal is to recover the ranking accurately but to sample the comparisons sparingly. If all comparison outcomes are consistent with the ranking, the optimal solution is to use an efficient sorting algorithm, such as Quicksort. But how do sorting algorithms behave if some comparison outcomes are inconsistent with the ranking? We give favorable guarantees for Quicksort for the popular Bradley-Terry model, under natural assumptions on the parameters. Furthermore, we empirically demonstrate that sorting algorithms lead to a very simple and effective active learning strategy: repeatedly sort the items. This strategy performs as well as state-of-the-art methods (and much better than random sampling) at a minuscule fraction of the computational cost.
From Incomplete Preferences to Ranking via Optimization
Chebotarev, Pavel, Shamis, Elena
We consider methods for aggregating preferences that are base d on the resolution of discrete optimization problems. For a review and references see Cook and Kress (1992), and Belkin and Levin (1990), and also David (1988) and Van B lokland-Vogelesang (1991). Some algorithmic aspects can be found in Barth elemy (1989) and Litvak (1982). The preferences are represented by arbitra ry binary relations (possibly weighted) or incomplete paired comparison matrices. The o utcome of an aggregation method is a set of "optimal" rankings (linear or weak ord ers) of the alternatives. Namely, a ranking is said to be optimal if it provides an ex tremum of some chosen objective function that expresses the connectio n (or proximity) between an arbitrary ranking and the original preferences.